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Abstract 

This paper proposes a novel Nyquist-rate analog-to-digital (A/D) conversion algorithm which achieves 
exponential accuracy in the bit-rate despite using imperfect components. The proposed algorithm is based 
on a robust implementation of a beta-encoder with [3 ^ (j) = [1 + \fb)/2, the golden ratio. It was 
previously shown that beta-encoders can be implemented in such a way that their exponential accuracy 
is robust against threshold offsets in the quantizer element. This paper extends this result by allowing for 
imperfect analog multipliers with imprecise gain values as well. We also propose a formal computational 
model for algorithmic encoders and a general test bed for evaluating their robustness. 

Index Terms 

Analog-to-digital conversion, beta encoders, beta expansions, golden ratio, quantization, robustness 

I. Introduction 

In A/D conversion, the aim is to quantize analog signals, i.e., to represent analog signals, which 
take their values in the continuum, by finite bitstreams. Basic examples of analog signals include audio 
signals and natural images. Frequently, the signal is first sampled on a grid in its domain, which is 
sufficiently dense so that perfect (or near-perfect) recovery from the acquired sample values is ensured 
by an appropriate sampling theorem. After this so-called sampling stage, there are two common strategies 
to quantize the sequence of sample values. Over sampling or SA Analog-to-Digital converters (or ADCs) 
incorporate memory elements in their structure so that the quantized value of a sample depends on other 
sample values and their quantization. The accuracy of such converters can be assessed by comparing 
the continuous input signal with the continuous output signal obtained from the quantized sequence 
(after a digital-to-analog (D/A) conversion stage). In contrast, Nyquist-rate ADCs quantize sample values 
separately, with the goal of approximating each sample value as closely as possible using a given bit- 
budget, i.e., the number of bits one is allowed to use to quantize each sample. In the case of Nyquist-rate 
ADCs, the analog objects of interest reduce to real numbers in some interval, say [0, 1]. 

In this paper we focus on Nyquist-rate ADCs. Let x G [0, 1]. The goal is to represent j; by a finite 
bitstream, say, of length N. A straightforward approach is to consider the standard binary (base-2) 
representation of x, 

oo 

x = ^6„2-", 6„G{0,1}. (1) 

n=l 
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and to let xn be the A^-bit truncation of the infinite series in ([T]), i.e., 

N 

X7v = J^fo„2-". (2) 

n=l 

It is easy to see that \x — xn\ < 2"^ so that (61, h2, ■ ■ ■ , bjsf) provide an A^-bit quantization of x with 
distortion not more than . This method is known as pulse code modulation (PCM) and essentially 
provides the most efficient encoding in a rate-distortion sense. 

As our goal is analog-to-digital conversion, the next natural question is how to compute the bits 6„ 
on an analog circuit. One popular method to obtain 6„, called successive approximation, extracts the bits 
using a recursive operation. Let xq = and suppose x„ is as in © for n > 1. Define Un := 2"(x — x^) 
for n > 0. It is easy to see that the sequence satisfies the recurrence relation 

Un = 2Un-l-bn, n = 1, 2, . . . , (3) 

and the bits can simply be extracted via the formula 

[ 0, Un-l < 1/2. 

Note that the relation ^ is the doubling map in disguise; n„ = T(n„_i), where T : n 2n (mod 1). 

The successive approximation algorithm as presented above provides an algorithmic circuit implemen- 
tation that computes the bits 6„ in the binary expansion of x while keeping all quantities and 
macroscopic and bounded, which means that these quantities can be held as realistic and measurable 
electric charges. However, despite the fact that base-2 representations, which essentially provide the 
optimal encoding in the rate-distortion sense, can be computed via a circuit, they are not the most 
popular choice of A/D conversion method. This is mainly because of robustness concerns: In practice, 
analog circuits are never precise, suffering from arithmetic errors (e.g., through nonlinearity) as well as 
from quantizer errors (e.g., threshold offset), simultaneously being subject to thermal noise. All relations 
hold only approximately, and therefore, all quantities are approximately equal to their theoretical values. 
In the case of the algorithm described in Q and ([U), this means that the approximation will exceed 
acceptable error bounds after only a finite (small) number of iterations because the dynamics of an 
expanding map has "sensitive dependence on initial conditions". This central problem in A/D conversion 
(as well as in D/A conversion) has led to the development of many alternative bit representations of 
numbers, as well as of signals, that have been adopted and/or implemented in circuit engineering, such 
as beta-representations and SA modulation. 

From a theoretical point of view, the imprecision problem associated to the successive approximation 
algorithm is not a sufficient reason to discard the base-2 representation out of hand. After all, we do 
not have to use the specific algorithm in Q and dUl to extract the bits, and conceivably there could be 
better, i.e., more resilient, algorithms to evaluate bn{x) for each x. However, the root of the real problem 
lies deeper: the bits in the base-2 representation are essentially uniquely determined, and are ultimately 
computed by a greedy method. Since 2~" = 2~"~^ + 2~"~^ + . . . , there exists essentially no choice 
other than to set 6„ according to dUl. (A possible choice exists for x of the form x = k2^^, with k an 
odd integer, and even then, only the bit bm can be chosen freely: for the choice bm = 0, one has bn = I 
for all n > m; for the choice bm = 1, one has bn = for all n > m.) It is clear that there is no way to 
recover from an erroneous bit computation: if the value 1 is assigned to 6„ even though x < + 2~", 
then this causes an "overshoot" from which there is no way to "back up" later. Similarly assigning the 
value to 6„ when x > Xn^i + 2^" implies a "fall-behind" from which there is no way to "catch up" 
later. 
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Due to this lack of robustness, the base-2 representation is not the preferred quantization method for 
A/D conversion. For similar reasons, it is also generally not the preferred method for D/A conversion. 
In practical settings, oversampled coarse quantization (SA modulation) is more popular [l]-[3], mostly 
due to its robustness achieved with the help of the redundant set of output codes that can represent each 
source value [4]. However, standard SA modulation is suboptimal as a quantization method (even though 
exponential accuracy in the bit rate can be achieved [5]). 

A partial remedy comes with fractional base expansions, called /^-representations [6]-[10]. Fix 1 < 
/3 < 2. It is well known that every x in [0, 1] (in fact, in [0, (/3 — 1)"^]) can be represented by an infinite 
series 

oo 

x = J]6„/3-^ (5) 

n=l 

with an appropriate choice of the bit sequence (6„). Such a sequence can be obtained via the following 
modified successive approximation algorithm: Define = — Then the bits bn obtained via 
the recursion 

Un = PUn-1 - bn, 

{0, Un-l < a, 

or 1, Un-i£ia,b), (6) 
1, Un^l > b. 

satisfy ([5]) whenever 1/(3 < a < b < l//3(/3— 1). If a = b = 1/(3, the above recursion is called the 
greedy selection algorithm; if a = 6 = \/[3{(3—l) it is the lazy selection algorithm. The intermediate 
cases correspond to what we call cautious selection. An immediate observation is that many distinct 
/5-representations in the form ^ are now available. In fact, it is known that for any 1 < /3 < 2, almost 
all numbers (in the Lebesgue measure sense) have uncountably many distinct /^-representations [11]. 
Although A^-bit truncated /^-representations are only accurate to within 0{(3~^), which is inferior to the 
accuracy of a base-2 representation, the redundancy of /3-representation makes it an appealing alternative 
since it is possible to recover from (certain) incorrect bit computations. In particular, if these mistakes 
result from an unknown threshold offset in the quantizer, then it turns out that a cautious selection 
algorithm (rather than the greedy or the lazy selection algorithms) is robust provided a bound for the 
offset is known [7]. In other words, perfect encoding is possible with an imperfect (flaky) quantizer 
whose threshold value fluctuates in the interval {1/ (3,1/ (3{(3 — 1)). 

It is important to note that a circuit that computes truncated /3-representations by implementing the 
recursion in Q has two critical parameters: the quantizer threshold (which, in the case of the "flaky 
quantizer", is the pair (a, b)) and the multiplier (3. As discussed above, /3-encoders are robust with 
respect to the changes in the quantizer threshold. On the other hand, they are not robust with respect 
to the value of (3 (see Section III-CI for a discussion). A partial remedy for this has been proposed in 
[8] which enables one to recover the value of [3 with the required accuracy, provided its value varies 
smoothly and slowly from one clock cycle to the next. 

In this paper, we introduce a novel ADC which we call the golden ratio encoder (GRE). GRE computes 
/3-representations with respect to base [3 = (j) = {l + ^/b)/2 via an implementation that is not a successive 
approximation algorithm. We show that GRE is robust with respect to its full parameter set while enjoying 
exponential accuracy in the bit rate. To our knowledge, GRE is the first example of such a scheme. 

The outline of the paper is as follows: In Section Hl-AI we introduce notation and basic terminology. 
In Section III-BI we review and formalize fundamental properties of algorithmic converters. Section 
III-CI introduces a computational model for algorithmic converters, formally defines robustness for such 
converters, and reviews, within the established framework, the robustness properties of several algorithmic 
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ADCs in the literature. Section Hill is devoted to GRE and its detailed study. In particular, Sections IlII-AI 
and IIII-BI introduce the algorithm underlying GRE and establish basic approximation error estimates. In 
Section ITlI-C I we give our main result, i.e., we prove that GRE is robust in its full parameter set. Sections 
ini-D[ IIII-EI and IIII-FI discuss several additional properties of GRE. Finally, in Section |lVl we comment 
on how one can construct "higher-order" versions of GRE. 

II. Encoding, Algorithms and Robustness 

A. Basic Notions for Encoding 

We denote the space of analog objects to be quantized by X. More precisely, let X be a compact 
metric space with metric dx- Typically dx will be derived from a norm || • || defined in an ambient 
vector space, via dx{x,y) = \\x — y\\. We say that Ej\[ is an N-bit encoder for X if Epj maps X to 
{0, 1}^. An infinite family of encoders {Ej\f}'^ is said to be progressive if it is generated by a single 
map E : X {0, 1}^ such that for x e X, 

En{x) = {E{x)o,E{x)u...,E{x)n-i). (7) 

In this case, we will refer to E as the generator, or sometimes simply as the encoder, a term which we 
will also use to refer to the family {Epf}'^. 

We say that a map D]\f is a decoder for E^- if -Dat maps the range of Ej^ to some subset of X. Once 
X is an infinite set, Ej\f can never be one-to-one, hence analog-to-digital conversion is inherently lossy. 
We define the distortion of a given encoder-decoder pair {E]\f,D]\!) by 

6xiEN,DN) ■■= sup dx{x,DN{EN{x))), (8) 

and the accuracy of E'at by 

A{En):= inf 5x{En,Dm). (9) 

The compactness of X ensures that there exists a family of encoders {E^^f and a corresponding 
family of decoders {Dn}'^' such that 5x{En , D^) — > as — > oo; i.e., all x e X can be recovered 
via the limit of Dn{En{x)). In this case, we say that the family of encoders {En}'i' is invertible. For 
a progressive family generated hy E : X ^ {0, 1}^, this actually implies that E is one-to-one. Note, 
however, that the supremum over x in ([8]l imposes uniformity of approximation, which is slightly stronger 
than mere invertibility of E. 

An important quality measure of an encoder is the rate at which A{Ej\[) ^ as — > oo. There 
is a limit to this rate which is determined by the space X. (This rate is connected to the Kolmogorov 
e-entropy of X, TLe{X), defined to be the base-2 logarithm of the smallest number k such that there 
exists an e-net for X of cardinality k [12]. If we denote the map e 7{e{X) by tp, i.e., ip{e) = 7{e{X), 
then the infimum of A{Ej^) over all possible encoders Ej^ is roughly equal to ip~^{N).) Let us denote 
the number inf£;^.xi-^{o,i}" A{En) by An{X). In general an optimal encoder may be impractical, and 
a compromise is sought between optimality and practicality. It is, however, desirable when designing 
an encoder that its performance is close to optimal. We say that a given family of encoders {E^}'^ is 
near-optimal for X, if 

A{En) < CAn{X), (10) 

where C > 1 is a constant independent of N. We will also say that a given family of decoders {Dat}^ 
is near-optimal for {Ej\r}'^, if 

6x{En,Dn)<CA{En). (11) 
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Fig. 1. The block diagram describing an algorithmic encoder. 



An additional important performance criterion for an ADC is whether the encoder is robust against 
perturbations. Roughly speaking, this robustness corresponds to the requirement that for all encoders 
{En} that are small (and mostly unknown) perturbations of the original invertible family of encoders 
{Ej\f}, it is still true that A{Ej^) — > 0, possibly at the same rate as Ep^, using the same decoders. The 
magnitude of the perturbations, however, need not be measured using the Hamming metric on {0, 1}'^ 
(e.g., in the form sup^.gx dH{EN{x), Ej^{x))). It is more realistic to consider perturbations that directly 
have to do with how these functions are computed in an actual circuit, i.e., using small building blocks 
(comparators, adders, etc.). It is often possible to associate a set of internal parameters with such building 
blocks, which could be used to define appropriate metrics for the perturbations affecting the encoder. 
From a mathematical point of view, all of these notions need to be defined carefully and precisely. For this 
purpose, we will focus on a special class of encoders, so-called algorithmic converters. We will further 
consider a computational model for algorithmic converters and formally define the notion of robustness 
for such converters. 



B. Algorithmic Converters 

By an algorithmic converter, we mean an encoder that can be implemented by carrying out an 
autonomous operation (the algorithm) iteratively to compute the bit representation of any input x. Many 
ADCs of practical interest, e.g., SA modulators, PCM, and beta-encoders, are algorithmic encoders. 
Figure [T] shows the block diagram of a generic algorithmic encoder. 

Let U denote the set of possible "states" of the converter circuit that get updated after each iteration 
(clock cycle). More precisely, let 

Q : X xU ^ {0,1} 



be a "quantizer" and let 



F -.X xU^U 



be the map that determines the state of the circuit in the next clock cycle given its present state. After 
fixing the initial state of the circuit uq, the circuit employs the pair of functions {Q, F) to carry out the 
following iteration: 

bn = Q{x,Un) 
Un+1 = F{x,Un) 



n = 0,l,... (12) 
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This procedure naturally defines a progressive family of encoders {E]\f}f^ with the generator map E 
given by 

E{x)n ■■= bn, n = 0, 1, . . . 

We will write AE{Q, F) to refer to the algorithmic converter defined by the pair {Q, F) and the implicit 
initial condition uq. If the generator E is invertible (on E{X)), then we say that the converter is invertible 
as well. 

Definition 1 (1-bit quantizer). We define the 1-bit quantizer with threshold value r to be the function 

(13) 




Examples of algorithmic encoders: 

1. Successive approximation algorithm for PCM. The successive approximation algorithm sets uq = 
X S [0, 2], and computes the bits 6„, n = 0, 1, . . . , in the binary expansion x = J2o^ ^n2~" via the 
iteration 

bn = qi{Un) 
Un+1 = '^{Un - bn) 



n = 0,l,... (14) 



n = 0,l,..., (15) 



Defining Q{x,u) = qi{u) and F{x,u) = 2{u — qi{u)), we obtain an invertible algorithmic converter 
for X = [0, 2]. A priori we can set = M, though it is easily seen that all the Un remain in [0, 2]. 
Beta-encoders with successive approximation implementation [7]. Let /? € (1, 2). A /3-representation 
of X is an expansion of the form x = Y^'^ bnP'"", where 6„ G {0, 1}. Unlike a base-2 representation, 
almost every x has infinitely many such representations. One class of expansions is found via the 
iteration 

bn = QriUn) 
Un+l = (3{Un - bn) 

where uq = x S [0, /3/ {(5 — 1)]. The case r = 1 corresponds to the "greedy" expansion, and the case 
T = — 1) to the "lazy" expansion. All values of r G [1, l/(/3 — 1)] are admissible in the sense 
that the Un remain bounded, which guarantees the validity of the inversion formula. Therefore the 
maps Q{x,u) = Qriu), and F{x,u) = — Qriu)) define an invertible algorithmic encoder for 
X = [0,/5]. It can be checked that all n„ remain in a bounded interval U independently of r. 
3. First-order SA with constant input. Let x G [0, 1]. The first-order SA (Sigma-Delta) ADC sets the 
value of uo G [0, 1] arbitrarily and runs the following iteration: 

bn = qi{Un + x) 
Un+1 = Un + X -br, 

It is easy to show that Un G [0, 1] for all n, and the boundedness of u„ implies 

1 ^ 

^ = J™ ^ y]^"' ^^^^ 

n=l 

that is, the corresponding generator map E is invertible. For this invertible algorithmic encoder, we 
have X = [0, 1], Li = [0, 1], Q{x, u) = qi{u-[- x), and F(x, u) = u x — qi{u x). 
kth-order SA with constant input. Let A be the forward difference operator defined by (An)^ = 
Un+1 — Un- A fcth-order SA ADC generalizes the scheme in Example 3 by replacing the first-order 
difference equation in ([T6l ) with 

{A''u)n = x-bn, n = 0,l,..., (18) 



n = 0, 1,... (16) 
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which can be rewritten as 



fc-1 

E(fc) 
a) 'Un+j 

i=o 



n 



0,1,... 



(19) 



where = (^/). Here 6„ G {0, 1} is computed by a function Q of x and the previous k 

state variables Un, ■ ■ ■ ,Un+k-i, which must guarantee that the n„ remain in some bounded interval 

for all 71, provided that the initial conditions uq, • • • , lifc-i are picked appropriately. If we define the 

r " ~^ 

vector state variable u„ = [n„ , • • • ,Uj 

equations in the form 



_i I , then it is apparent that we can rewrite the above 



bn 

i+l 



Q{x,Un) 

LfcU„ + xe 



6„e 



n 



0,1, 



(20) 



where is the k x k companion matrix defined by 












1 








1 



(21) 



and e = [O, • • • , 0, l] . 
implies F{x,u) := L^u 



If Q is such that there exists a set C M'^ with the property u ^ U 
f (x — Q{x, u))e G U for each x £ X, then it is guaranteed that the Un 



are bounded, i.e., the scheme is stable. Note that any stable kth order scheme is also a first order 
scheme with respect to the state variable (A'^~^n)„. This implies that the inversion formula ([TT] ) 
holds, and therefore (l20l ) defines an invertible algorithmic encoder. Stable SA schemes of arbitrary 
order k have been devised in [13] and in [5]. For these schemes X is a proper subinterval of [0, 1]. 



C. A Computational Model for Algorithmic Encoders and Formal Robustness 

Next, we focus on a crucial property that is required for any ADC to be implementable in practice. As 
mentioned before, any ADC must perform certain arithmetic (computational) operations (e.g., addition, 
multiplication), and Boolean operations (e.g., comparison of some analog quantities with predetermined 
reference values). In the analog world, these operations cannot be done with infinite precision due to 
physical limitations. Therefore, the algorithm underlying a practical ADC needs to be robust with respect 
to implementation imperfections. 

In this section, we shall describe a computational model for algorithmic encoders that includes all the 
examples discussed above and provides us with a formal framework in which to investigate others. This 
model will also allow us to formally define robustness for this class of encoders, and make comparisons 
with the state-of-the-art converters. 

Directed Acyclic Graph Model: Recall (fT2l ) which (along with Figure [J) describes one cycle of an 
algorithmic encoder. So far, the pair {Q, F) of maps has been defined in a very general context and 
could have arbitrary complexity. In this section, we would like to propose a more realistic computational 
model for these maps. Our first assumption will be that X C M and hi C M.'^. 

A directed acyclic graph (DAG) is a directed graph with no directed cycles. In a DAG, a source is a 
node (vertex) that has no incoming edges. Similarly, a sink is a node with no outgoing edges. Every DAG 
has a set of sources and a set of sinks, and every directed path starts from a source and ends at a sink. 
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Fig. 2. A sample DAG model for the function pair (Q,F). 
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Fig. 3. A representative class of components in an algorithmic encoder. 



Our DAG model will always have d + \ source nodes that correspond to x and the d-dimensional vector 
u„, and d+1 sink nodes that correspond to hn and the li-dimensional vector u^+i. This is illustrated in 
Figure |2] which depicts the DAG model of an implementation of the Golden Ratio Encoder (see Section 
Hm and Figure |4|. Note that the feedback loop from Figure [T] is not a part of the DAG model, therefore 
the nodes associated to x and u„ have no incoming edges in Figure |2] Similarly the nodes associated to 
hn and u„_|_i have no outgoing edges. In addition, the node for x, even when x is not actually used as 
an input to (Q, F), will be considered only as a source (and not as a sink). 

In our DAG model, a node which is not a source or a sink will be associated with a component, i.e., 
a computational device with inputs and outputs. Mathematically, a component is simply a function (of 
smaller "complexity") selected from a given fixed class. In the setting of this paper, we shall be concerned 
with only a restricted class of basic components: constant adder, pair adder/subtractor, constant multiplier, 
pair multiplier, binary quantizer, and replicator. These are depicted in Figure [3] along with their defining 
relations, except for the binary quantizer, which was defined in (fT3l) . Note that a component and the node 
at which it is placed should be consistent, i.e., the number of incoming edges must match the number 
of inputs of the component, and the number of outgoing edges must match the number of outputs of the 
component. 

When the DAG model for an algorithmic encoder defined by the pair (Q, F) employs the ordered k- 
tuple of components C = (Ci, . . . , C^) (including repetitions), we will denote this encoder by AE((5, F, C). 

Robustness: We would like to say that an invertible algorithmic encoder AE(Q,F) is robust if 
AE(Q, F) is also invertible for any [Q, F) in a given neighborhood of {Q, F) and if the generator 



X , 




a 



+ 



+ 



Fig. 4. Block diagram of tlie Golden Ratio Encoder (Section InB corresponding to the DAG model in Figure (2] 



E of AE((5, F) has an inverse D defined on {0, 1}^ that is also an inverse for the generator E of 
PiE{Q,F). To make sense of this definition, we need to define the meaning of "neighborhood" of the 
pair {Q,F). 

Let us consider an algorithmic encoder AE((5, F, C) as described above. Each component Cj in C may 
incorporate a vector Aj of parameters (allowing for the possibility of the null vector). Let A = (Ai, . . . , A^) 
be the aggregate parameter vector of such an encoder. We will then denote C by C(A). 

Let A be a space of parameters for a given algorithmic encoder and consider a metric on A. We 
now say that AE((5, F, C(Ao)) is robust if there exists a (5 > such that AE(Q,F, C(A)) is invertible for 
all A with pa(A,Ao) < 5 with a common inverse. Similarly, we say that AE(Q, F, C(Ao)) is robust in 
approximation if there exists a > and a family {L>jv}f° such that 

5x{En,Dm)<CA{Em) 

for all En = En{Q, F, A) with pa(A, Aq) < 6, where Ej^ = En{Q, F, Aq). 

From a practical point of view, if an algorithmic encoder AE{Q, F,C{Xo)) is robust, and is imple- 
mented with a perturbed parameter A instead of the intended Aq, one can still obtain arbitrarily good 
approximations of the original analog object without knowing the actual value of A. However, here we 
still assume that the "perturbed" encoder is algorithmic, i.e., we use the same perturbed parameter value 
A at each clock cycle. In practice, however, many circuit components are "flaky", that is, the associated 
parameters vary at each clock cycle. We can describe such an encoder again by (fT2l) . however we need to 
replace {Q,F) by {Q\^,F\,^), where {A"}f^ is the sequence of the associated parameter vectors. With 
an abuse of notation, we denote such an encoder by AE(Qa"i^A") (even though this is clearly not an 



algorithmic encoder in the sense of Section Hl-BI ). Note that if {A*^}^ 



An , i.e.. A'' 



Aq for all n, 



the corresponding encoder is AE{Q, F,C{Xo))- We now say that AE{Q, F,C{Xo)) is strongly robust if 
there exists 6 > such that AE(QA",i^A") is invertible for aU {A"}f= with PANliA"}?", A^) < <5 with 
a common inverse. Here, A^ is the space of parameter sequences for a given converter, and p^r* is an 
appropriate metric on A^. Similarly, we call an algorithmic encoder strongly robust in approximation if 
there exists 5 > and a family {Dn}'^' such that 



5x{E'n,Dn)<CA{E, 



N 
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for all flaky encoders Ej^ = E^j^{Q\^,F\^) with PN{{^n}i ,^o,n) < ^ where p^r is the metiic on 
obtained by restricting p^n (assuming such a restriction makes sense), Ao,7v is the N-tuple whose 
components are each Aq, and = E]\j{Q, F, Aq). 

Examples of Section UI-Bi Let us consider the examples of algorithmic encoders given in section III-BI 
The successive approximation algorithm is a special case of the beta encoder for /? = 2 and r = 1. As 
we mentioned before, there is no unique way to implement an algorithmic encoder using a given class of 
components. For example, given the set of rules set forth earlier, multiplication by 2 could conceivably 
be implemented as a replicator followed by a pair adder (though a circuit engineer would probably not 
approve of this attempt). It is not our goal here to analyze whether a given DAG model is realizable in 
analog hardware, but to find out whether it is robust given its set of parameters. 

The first order SA quantizer is perhaps the encoder with the simplest DAG model; its only parametric 
component is the binary quantizer, characterized by r = 1. For the beta encoder it is straightforward to 
write down a DAG model that incorporates only two parametric components: a constant multiplier and 
a binary quantizer. This model is thus characterized by the vector parameter A = (/?, r). The successive 
approximation encoder corresponds to the special case Aq = (2, 1). If the constant multiplier is avoided 
via the use of a replicator and adder, as described above, then this encoder would be characterized by 
r = 1, corresponding to the quantizer threshold. 

These three models (SA quantizer, beta encoder, and successive approximation) have been analyzed 
in [7] and the following statements hold: 

1) The successive approximation encoder is not robust for Aq = (2, 1) (with respect to the Euclidean 
metric on A = M^). The implementation of successive approximation that avoids the constant 
multiplier as described above, and thus characterized by r = 1 is not robust with respect to r. 

2) The first order SA quantizer is strongly robust in approximation for the parameter value tq = 1 
(and in fact for any other value for tq). However, A{Ej\[) = @{N^^) for X = [0, 1]. 

3) The beta encoder is strongly robust in approximation for a range of values of tq, when P = (3q 
is fixed. Technically, this can be achieved by a metric which is the sum of the discrete metric on 
the first coordinate and the Euclidean metric on the second coordinate between any two vectors 
A = r), and Aq = {Po,to). This way we ensure that the first coordinate remains constant on a 
small neighborhood of any parameter vector. Here A{E]\f) = 0(/3~^) for X = [0, 1]. This choice 
of the metric however is not necessarily realistic. 

4) The beta encoder is not robust with respect to the Euclidean metric on the parameter vector space 
A = in which both (3 and r vary. In fact, this is the case even if we consider changes in f3 only: 
let E and E be the generators of beta encoders with parameters r) and (/3 + 5, r), respectively. 
Then E and E do not have a common inverse for any (5 / 0. To see this, let = E{x). Then 
a simple calculation shows 

oo , 

1 

where k = min{n : 6„ / 0} < oo for any x 0. Consequently, E~^ / E~^. 
This shows that to decode a beta-encoded bit-stream, one needs to know the value of /3 at least within 
the desired precision level. This problem was addressed in [8], where a method was proposed for 
embedding the value of (3 in the encoded bit-stream in such a way that one can recover an estimate 
for (3 (in the digital domain) with exponential precision. Beta encoders with the modifications of 
[8] are effectively robust in approximation (the inverse of the generator of the perturbed encoder 
is different from the inverse of the intended encoder, however it can be precisely computed). Still, 
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even with these modifications, the corresponding encoders are not strongly robust with respect to 
the parameter f3. 

5) The stable SA schemes of arbitrary order k that were designed by Daubechies and DeVore, [13], 
are strongly robust in approximation with respect to their parameter sets. Also, a wide family 
of second-order SA schemes, as discussed in [14], are strongly robust in approximation. On the 
other hand, the family of exponentially accurate one-bit SA schemes reported in [5] are not robust 
because each scheme in this family employs a vector of constant multipliers which, when perturbed 
arbitrarily, result in bit sequences that provide no guarantee of even mere invertibility (using the 
original decoder). The only reconstruction accuracy guarantee is of Lipshitz type, i.e. the error of 
reconstruction is controlled by a constant times the parameter distortion. 
Neither of these cases result in an algorithmic encoder with a DAG model that is robust in its full set 
of parameters and achieves exponential accuracy. To the best of our knowledge, our discussion in the 
next section provides the first example of an encoder that is (strongly) robust in approximation while 
simultaneously achieving exponential accuracy. 



III. The Golden Ratio Encoder 

In this section, we introduce a Nyquist rate ADC, the golden ratio encoder (GRE), that bypasses 
the robustness concerns mentioned above while still enjoying exponential accuracy in the bit-rate. In 
particular, GRE is an algorithmic encoder that is strongly robust in approximation with respect to its full 
set of parameters, and its accuracy is exponential. The DAG model and block diagram of the GRE are 
given in Figures |2] and |4l respectively. 



A. The scheme 



We start by describing the recursion underlying the GRE. To quantize a given real number x £ X = 
[0, 2], we set uq = x and ui = 0, and run the iteration process 

Un+2 = Un+1 + Un - K, 

bn = Q{Un,Un+l). (22) 

Here, Q : M^i-^{0,l}isa quantizer to be specified later. Note that (l22l ) describes a piecewise affine 
discrete dynamical system on 



l^. More precisely, define 



u 




"0 


1' 




u 


- Q{u,v) 


"0" 


V 


1 — > 


1 


1 




V 


1 



(23) 



Then we can rewrite (l22l) as 



Un+l 
Un+2 



'Q 



Un+l 



(24) 



Now, let X = [0, 2), U C M^, and suppose Q is a quantizer on X x U. The formulation in (l24l) shows 
that GRE is an algorithmic encoder, AE((5,Fgre), where FGRE(a;,u) := Au — Q{u) for u £ Li. Next, 
we show that GRE is invertible by establishing that, if Q is chosen appropriately, the sequence 5 = 
obtained via (l22l ) gives a beta representation of x with (3 = cf) = {1 + \/5)/2. 
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B. Approximation Error and Accuracy 

Proposition 1. Let x G [0, 2) and suppose 6„ are generated via (1221 ) with uq = x and ui = 0. Then 



oo 
n=0 



if and only if the state sequence is bounded. Here is the golden mean. 

Proof: Note that 



n=0 n=0 
Af-1 



~N+1 

"-nV^ V-^~'~V^ — J ~i~ "-l ~i~ ~r "-U ~r u-iv^ — "-JVV^ — "-JV + iV^ 

n=2 

= X - (/)"^(nAr + </)UAr+i). (25) 

where the third equaUty follows from 1 + (f) — cjp' = 0, and the last equality is obtained by setting uq = x 
and ui = 0. Defining the iV-term approximation error to be 

N-l 

eN{x) := X - ^ = (p~^{uN + (pUN+i) 

n=0 

it follows that 



provided 



lim eAr(x) 
Af^oo 



lim = 0. (26) 

n— ♦oo 



Clearly, (1261 ) is satisfied if there is a constant C, independent of n, such that |n.„| < C, . Conversely, 
suppose (|26l ) holds, and assume that is unbounded. Let N be the smallest integer for which |nAr| > 
C'(f)^ for some C' > 1. Without loss of generality, assume un > (the argument below, with simple 
modifications, applies if un < 0). Then, using (l22l ) repeatedly, one can show that 

UN+k > C'(j)^fk-1 - fk+2 + 1 

where fk is the fcth Fibonacci number. Finally, using 

'A'^ - (1 - (/))'' 



fk 



V5 

(which is known as Binet's formula, e.g., see [15]) we conclude that u^^k ^ C"(j)'' for every positive 
integer k, showing that (l26l ) does not hold if the sequence {un) is not bounded. 

■ 

Note that the proof of Proposition [T] also shows that the A^-term approximation error eAr(x) decays 
exponentially in if and only if the state sequence (u„), obtained when encoding x, remains bounded 
by a constant (which may depend on x). We will say that a GRE is stable on X if the constant C in 
Proposition [His independent of x S X, i.e., if the state sequences u with uq = x and ui = are bounded 
by a constant uniformly in x. In this case, the following proposition holds. 
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Proposition 2. Let E^'^^ be the generator of the GRE, described by (l22l ). If the GRE is stable on X, it 
is exponentially accurate on X. In particular, A{E^^^) = 

Next, we investigate quantizers Q that generate stable encoders. 

C. Stability and robustness with respect to imperfect quantizers 

To establish stability, we will show that for several choices of the quantizer Q, there exist bounded 
positively invariant sets Rq such that Tq{Rq) C Rq. We will frequently use the basic 1-bit quantizer. 



0, if n < 1, 

1, ifn>l. 



Most practical quantizers are implemented using arithmetic operations and qi. One class that we will 
consider is given by 

^ , , , , ( 0, if u + av < I, 

Qa{u,v) := qi{u + av) = < (27) 

II, it u + av > I. 

Note that in the DAG model of GRE, the circuit components that implement Qa incorporate a parameter 
vector A = (r, a) = (1, a). Here, r is the threshold of the 1-bit basic quantizer, and a is the gain factor 
of the multiplier that maps v to av. One of our main goals in this paper is to prove that GRE, with 
the implementation depicted in Figure IH is strongly robust in approximation with respect to its full set 
of parameters. That is, we shall allow the parameter values to change at each clock cycle (within some 
margin). Such changes in parameter r can be incorporated to the recursion (l22l ) by allowing the quantizer 
Qa to be flaky. More precisely, for ui < 1/2, let g^i''^^ ]jq |-}^g flaky version of q^ defined by 

0, if u < z^i, 

:= J 1, ifu>U2, 

or 1, if z/i < u < 1^2- 

We shall denote by Qa''^^ the flaky version of Qa, which is now 

■.= q''''''-{u + av). 

Note that (|22)) . implemented with Q = Qa''^^, does not generate an algorithmic encoder. At each clock 
cycle, the action of Qa''^^ is identical to the action of (5cr'^"(^t, v) := qr^{u + av) for some r„ G [ui, V2). 
In this case, using the notation introduced before, (l22l) generates AE(F(^j^g, Qq"'^"). We will refer to this 
encoder family as GRE with flaky quantizer. 

I) A stable GRE with no multipliers: the case a = 1: We now set a = 1 in (l27l ) and show that the 
GRE implemented with Qi is stable, and thus generates an encoder family with exponential accuracy (by 
Proposition |2l). Note that in this case, the recursion relation (l22l ) does not employ any multipliers (with 
gains different from unity). In other words, the associated DAG model does not contain any "constant 
multiplier" component. 

Proposition 3. Consider Tq^, deflned as in ( 1231 ). Then Rq^ := [0, 1]^ satisfies 

TqARqi) = Rqi- 

Proof: By induction. It is easier to see this on the equivalent recursion (l22l ). Suppose {un,Un+i) G 
i?Qj, i.e., Un and u„+i are in [0, 1]. Then Un+2 = Un + Un+i — Qiiun + Un+i) is in [0, 1], which concludes 
the proof. ■ 
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It follows from the above proposition that the GRE implemented with Qi is stable whenever the initial 
state {x,0) G Rq^, i.e., x £ [0, 1]. In fact, one can make a stronger statement because a longer chunk of 
the positive real axis is in the basin of attraction of the map Tq^ . 

Proposition 4. The GRE implemented with Qi is stable on [0, 1 + </>), where (j) is the golden mean. More 
precisely, for any x E [0, 1 + 0), there exists a positive integer Nx such that Un G [0, 1] for all n > N^. 

Corollary 5. Let x € [0,1 + (/)), set uq = x, ui = 0, and generate the bit sequence (bn) by running the 
recursion (|22ll with Q = Qi. Then, for N > Nx, 

N-l 



n=0 

One can choose Nx uniformly in x in any closed subset of [0, 1 + (p). In particular, Nx = for all 
X G [0,1]. 



Remarks. 

1) The proofs of Proposition |4] and Corollary |5] follow trivially from Proposition |3] when x G [0, 1]. It 
is also easy to see that Nx = I for x (1, 2], i.e., after one iteration the state variables ui and U2 
are both in [0, 1]. Furthermore, it can be shown that 

0<x<l + 4^--^ ^ Nx<N, 

JN+I JN+1 

where /„ denotes the nth Fibonacci number. We do not include the proof of this last statement here, 
as the argument is somewhat long, and the result is not crucial from the viewpoint of this paper. 

2) In this case, i.e., when a = 1, the encoder is not robust with respect to quantizer imperfections. More 
precisely, if we replace Qi with Qi^''^^, with z^i, 1^2 G {^ — S,l + 6), then |n„| can grow regardless of 
how small J > is. This is a result of the mixing properties of the piecewise affine map associated 
with GRE. In particular, one can show that [0, 1] x {0} C U„5„, where Sn C [0, 1]^ is the set of 
points whose nth forward image is outside the unit square. Figure [5] shows the fraction of 10,000 
randomly chosen x-values for which \un\ > 1 as a function of A^. In fact, suppose uq = x with 
X G [0, 1] and ui = 0. Then, the probability that ujv is outside of [0, 1] is 0{N6'^ + 4>~^), which is 
superior to the case with PCM where the corresponding probability scales like N5. This observation 
suggests that "GRE with no multipliers", with its simply-implementable nature, could still be useful 
in applications where high fidelity is not required. We shall discuss this in more detail elsewhere. 

2 ) Other values of a: stable and robust GRE: In the previous subsection, we saw that GRE, imple- 
mented with Qa, a = 1, is stable on [0, 1 + 1;^), and thus enjoys exponential accuracy; unfortunately, the 
resulting algorithmic encoder is not robust. In this subsection, we show that there is a wide parameter 
range for vi,U2 and a for which the map Tq with Q = Q^a'^'^ has positively invariant sets R that do 
not depend on the particular values of vi and a. Using such a result, we then conclude that, with the 
appropriate choice of parameters, the associated GRE is strongly robust in approximation with respect 
to T, the quantizer threshold, and a, the multiplier needed to implement Q^. We also show that the 
invariant sets R can be constructed to have the additional property that for a small value of /i > one 
has Tq{R) + B^{0) C R, where -6/^(0) denotes the open ball around with radius fi. In this case, R 
depends on p. Consequently, even if the image of any state {u, v) is perturbed within a radius of p., it 
stiU remains within R. Hence we also achieve stability under small additive noise or arithmetic errors. 

Lemma 6. Let < p < (2(/)^a/0"+^)^^ ~ 0.1004. TJiere is a set R = R{p), explicitly given in 
and a wide range for parameters z^i, U2, and a such that Tq-^i.-'2 (R) C i? + i?^(0). 
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Fig. 5. We choose 10,000 values for x, uniformly distributed in [0, 1] and run the recursion i22\ with Q — QJ"^'"^ with 
Vi £ {1 — S,l + S). The graphs show the ratio of the input values for which |ujv| > 1 vs. for S = 0.05 (solid) and S — 0.1 
(dashed). 



Proof: Our proof is constructive. In particular, for a given /i, we obtain a parametrization for R, 
which turns out to be a rectangular set. The coiTcsponding ranges for i'i,i'2, and a are also obtained 
implicitly below. We will give explicit ranges for these parameters later in the text. 

Our construction of the set R, which only depends on fi, is best explained with a figure. Consider the 
two rectangles AiBiCiDi and A2B2C2D2 in Figure |6] These rectangles are designed to be such that 
their respective images under the linear map Ti, and the affine map T2, defined by 



u 




"0 


1 




1 — > 


1 


1 


V 





and To 



u 


1 — > 


"0 


1' 




u 




"0" 


V 




1 


1 




V 




1 



(28) 



are the same, i.e., Ti{AiBiCiDi) = ABCD = T2{A2B2C2D2). 

The rectangle ABCD is such that its /^-neighborhood is contained within the union of AiBiCiDi and 
A2B2C2D2. This guards against additive noise. The fact that the rectangles AiBiCiDi and A2B2C2D2 
overlap (the shaded region) allows for the use of a flaky quantizer. Call this region F. As long as the 
region in which the quantizer operates in the flaky mode is a subset of F, and Tq = Ti on AiBiCiDi\F 
and Tq = T2 on A2B2C2D2 \ F, it follows that Tq{AiBiCiDi U A2B2C2D2) C ABCD. It is then 
most convenient to choose R = R{fi) = Af B2Cf Di and we clearly have Tq{R) + Bfj_{0) C R. Note 
that if Q = Q^a'^\ any choice z^i,t'2> and a for which the graph of w = —-u + - remains inside the 
shaded region F for vi < v < V2 will ensure Tq{R) C i? + B^{0). 

Next, we check the existence of at least one solution to this setup. This can be done easily in terms 
the parameters defined in the figure. First note that the linear map Ti has the eigenvalues —l/cj) and (j) 
with corresponding (normalized) eigenvectors = ■^^^|(<^, —1) and <I>2 = cj)). Hence Ti acts 

as an expansion by a factor of cp along $2> and reflection followed by contraction by a factor of (p along 
^i. T2 is the same as Ti followed by a vertical translation of —1. It follows after some straightforward 
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Fig. 6. A positively invariant set and the demonstration of its robustness with respect to additive noise and imperfect 
quantization. 



algebraic calculations that the mapping relations described above imply 



,2 
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Consequently, the positively invariant set R is the set of all points inside the rectangle Af B2C^ Di 
where 

A* = -l2^i + di$2 
B2 = -h^l + {d2 + /l2)$2 

C* = ri^>i + (ds + /i2)$2 

Di = ri$i + di$2 (29) 

Note that R depends only on /i. Moreover, the existence of the overlapping region F is equivalent to the 
condition di + hi > d2 which turns out to be equivalent to 

a < — ^ ^ w 0.1004. 

■ 

Flaky quantizers, linear thresholds: Next we consider the case Q = Q^a'^'^ and specify ranges for 
1/1,1/2, and a such that Tq{R{h)) C R{h) + 5^(0). 

Proposition 7. Lef < /x < J^^-p^ anJ a s'mc/i f/iaf 

a«,m(M) := 1 + 2/i(/)v^ + 2 < a < 3 - ^^^^^p^^^= =: a„^^{ii) (30) 

1 + 4/iV<P + 2 



be fixed. Define 



a — f-i4>\/(j) + 2, < , , 



i^mm(a, /Uo) < 1^1 < 1^2 < t'max(a, /^o). f'^^?" ^Q^i ''^ (^(/")) ^ + ^/^(O) far every /x G [0, /xq]- 

Remarks. 

1) The dark line segment depicted in Figure |6] within the overlapping region F, refers to a hypothetical 
quantizer threshold that is allowed to vary within F. Proposition |7] essentially determines the vertical 
axis intercepts of lines with a given slope, — 1/a, the corresponding segments of which remain in 
the overlapping region F. The proof is straightforward but tedious, and will be omitted. 

2) In Figure |7] we show Uminict, fJ-) and I'maxioi, ^J,) for /x = 0,0.01,0.03. Note that Vmin and Vmax are 
both increasing in a. Moreover, for a in the range shown in (l30l ). we have Uminict, /x) < fmax(«, fJ-) 
with Vmax{a,fx) = i>min{a,lj) at the two endpoints, amin{lj) and Uminilj)- Hence, Umin and Umax 
enclose a bounded region, say G(/x). If {a} x [z^i, 1/2] is in G(/Li), then Tq{R{^)) C i?(/x) + -6,^(0) 
for Q = Q^^''^^ 

3) For any G {oimin{l^)TCimax{l^)), note that f^i^ is invertible at a/, and set 

Then, for any au G (aL,a^), we have 

{aL,au) X (z^i,i/2) G G(/x) 

provided 

I'L := T^min{au) <1^1<V2< Vmax{aL) ='■ ■ 
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u -u 
Gain (a) 

Fig. 7. We plot Vmin{a, and u,nin{a,jj,) with /i — 0.03 (dashed), /i — 0.01 (solid), and /i = (dotted). If {a} x [i>\,V2\ 
remains in the shaded region, then Tq<-'i.<^2 C + 5^(0) for /i = 0.01. 



Note also that for any {a\,a2) C (aL,a^), we have fmm(a2) < ^max{cti)- Thus, 

(ai,a2) X (z^i,z^2) C G{fi) 
if Vm.in{ot2) ^ ^1 < ^2 < i^max{cti)- Consequently, we observe that 

for any a £ {ai,a2) and [1^1,^2] C [^'mm(a2) 
4) We can also determine the allowed range for a, given the range for 1^1,1^2, by reversing the argument 

are 



above. The extreme values of i^min and lymax 



^min {(^max ) 



1 +/U 



+ 2, 



+ 2 + 3^(# + 3) 



((/> + W^/^+2)(,^ + 2) ■ 
For any in the open interval between these extreme values, set 

l^h ■■= '^maxi'^'lni'^L))- 

Then, for any uu S {vl,u^), {aL,au) x {vl,vu) is in the allowed region where 



(33) 
(34) 



(35) 
(36) 



This is shown in Figure |2l Consequently, we observe that GRE implemented with Q = Q^a'^^ 
remains stable for any z^i, V2 and a provided \v\^ V2\ C (z^l, ^u) and a G {oil-, ajj)- 
5) For the case /i = 0, the expressions above simplify significantly. In (l30l ). amm(O) = 1 and amax{'^) = 
3. Consequently, the extreme values Vmin and i^max are 1 and 2, respectively. One can repeat the 
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calculations above to derive the allowed ranges for the parameters to vary. Observe that /x = gives 
the widest range for the parameters. This can be seen in Figure I?] 

We now go back to the GRE and state the implications of the results obtained in this subsection. The 
recursion relations (l22l ) that define GRE assume perfect arithmetic. We modify (l22l ) to allow arithmetic 
imperfections, e.g., additive noise, as follows 

Un+2 = Un+l + - K + (^n, 

K = Q{Un,Un+l), (37) 

and conclude this section with the following stability theorem. 

Theorem 8. Let S [0, ^^5-^==), amin{lJ') and amaxilj) as in (l30l ). For every 

a G {oLmin{lj),<y-max{lj))> there exists 2^1,^2, and rj > such that the encoder described by (l37l ) with 
Q = Q'^,''^^ is stable provided \a' — a\ < rj and |e„| < /i. 

Proof: This immediately follows from our remarks above. In particular, given a, choose ai < a 
such that the corresponding = K~i„(^'maa;(Q^L)) > By monotonicity of both Umin and i^max, any 
OIL G {u^\rc{umin{o)),a) will do. Next, choose some au G (a, a^), and set rj := mm{a — ai, ctu — a}. 
The statement of the theorem now holds with z/i = I'minictu) and 1^2 = fmaxidL)- ■ 
When /U = 0, i.e., when we assume the recursion relations ((22l) are implemented without an additive 
error. Theorem [8] implies that GRE is strongly robust in approximation with respect to the parameter 
a, vi, and 1/2. More precisely, the following corollary holds. 

Corollary 9. Let x £ [0, 1], and a £ (1, 3). There exist t] > 0, and vi, 1^2 such that bn, generated via (122b 
with uq = X, ui = 0, and Q = Q'^,''^^, approximate x exponentially accurately whenever \a' — a\ < rj. 
In particular, the N-term approximation error eAr(x) satisfies 

N-l 

e^{x) = x-Y^ bn(f>~'' < C(t)-^ 

n=0 

where C = 1 + 4>. 

Proof: The claim follows from Proposition [T] and Theorem [D Given a, set ji = 0, and choose i^i, f2, 
and rj as in Theorem[8l As the set -R(O) contains [0, 1] x {0}, such a choice ensures that the corresponding 
GRE is stable on [0, 1]. Using Proposition [TJ we conclude that eN{x) < (p^^ (un + (pUN+i). Finally, as 

{uN,UN+l) G -R(O), 

UN + (pUN+i < max u + (f)v = 1 + (j). 

{u,v)eR{0} 



D. Effect of additive noise and arithmetic errors on reconstruction error 

Corollary |9] shows that the GRE is robust with respect to quantizer imperfections under the assumption 
that the recursion relations given by (l22l ) are strictly satisfied. That is, we have quite a bit of freedom 
in choosing the quantizer Q, assuming the arithmetic, i.e., addition, can be done error-free. We now 
investigate the effect of arithmetic errors on the reconstruction error. To this end, we model such 
imperfections as additive noise and, as before, replace (l22l ) with ( [37] ). where e„ denotes the additive 
noise. While Theorem [8] shows that the encoder is stable under small additive errors, the reconstruction 
error is not guaranteed to become arbitrarily small with increasing number of bits. This is observed in 
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additive distortion level 



40 50 60 

number of bits spent 



Fig. 8. Demonstration of the fact that reconstruction error saturates at the noise level. Here the parameters are ui = 1.2, 
V2 = 1.3, a = 1.5, and |e„| < 2"^ 



Figure [8] where the system is stable for the given imperfection parameters and noise level, however the 
reconstruction error is never better than the noise level. 
Note that for stable systems, we unavoidably have 

N-l 

J]M~" = ^+ 2]en<A~" + 0(r'^), (38) 

71=0 71=0 



where the "noise term" in ( [38]) does not vanish as N tends to infinity. To see this, define e^v 
Yln=o ^n4'~^- If we assume e„ to be i.i.d. with mean and variance cj^, then we have 

Var(eAf) = -^(pa as ^ oo. 

1 — (p ^ 

Hence we can conclude from this the x-independent result 

2 



E 



n=0 

In Figure [H we incorporated uniform noise in the range [— 2~^,2^^]. This would yield (pa'^ = 
2^^^0/3 2^^'^, hence the saturation of the root-mean-square-error (RMSE) at 2~^-^. Note, however, 
that the figure was created with an average over 10,000 randomly chosen x values. Although independent 
experiments were not run for the same values of x, the x-independence of the above formula enables us 
to predict the outcome almost exactly. 

In general, if p is the probability density function for each e„, then en will converge to a random 
variable the probability density function of which has Fourier transform given by the convergent infinite 
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product 



oo 
n=0 



E. Bias removal for the decoder 

Due to the nature of any 'cautious' beta-encoder, the standard A^-bit decoder for the GRE yields 
approximations that are biased, i.e., the error eN{x) has a non-zero mean. This is readily seen by the 
error formula 

eAr(x) = 4)~^{UN + (t>UN+l) 

which implies that e7v(a^) > for all x and N. Note that all points (n, v) in the invariant rectangle Rq 
satisfy u + (l)v > 

This suggests adding a constant (x-independent) term to the standard A^-bit decoding expression 
to minimize ||eAr||. Various choices are possible for the norm. For the oo-norm, should be chosen to 
be average value of the minimum and the maximum values of eAr(x). For the 1-norm, ^jv should be the 
median value and for the 2-norm, should be the mean value of eN{x). Since we are interested in the 
2-norm, we will choose via 



= (t) ^jjj- j {un{x) +(f>UN+l{x)) dx, 



where / is the range of x values and we have assumed uniform distribution of x values. 

This integral is in general difficult to compute explicitly due to the lack of a simple formula for 
un{x). One heuristic that is motivated by the mixing properties of the map Tq is to replace the average 
value |/|^^ fjUj\f{x) dx by f^ududv. If the set of initial conditions {(x,0) : x G /} did not have zero 
two-dimensional Lebesgue measure, this heuristic could be turned into a rigorous result as well. 

However, there is a special case in which the bias can be computed explicitly. This is the case a = I 
and ui = U2 = 1. Then the invariant set is [0, 1)^ and 
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where (•) denotes the coordinate-wise fractional part operator on any real vector. Since (fcx) dx = 1/2 
for all non-zero integers k, it follows that un{x) dx = 1/2 for all N. Hence setting / = [0, 1], we 
find 

-TV 1 + _ 1 ,_Ar+2 



2 2" 

It is also possible to compute the integral /p u dudv explicitly when a = (j) and vi = 1^2 = v for some 
= [1, 0]. In this case it can be shown that the invariant set T is the union of at most 3 rectangles whose 
axes are parallel to <I>i and $2- We omit the details. 



F. Circuit implementation: Re quantization 

As we mentioned briefly in the introduction, A/D converters (other than PCM) typically incorporate 
a requantization stage after which the more conventional binary (base-2) representations are generated. 
This operation is close to a decoding operation, except it can be done entirely in digital logic (i.e., 
perfect arithmetic) using the bitstreams generated by the specific algorithm of the converter. In principle 
sophisticated digital circuits could also be employed. 
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Fig. 9. Efficient digital implementation of the requantization step for the Golden Ratio Encoder. 



In the case of the Golden Ratio Encoder, it turns out that a fairly simple requantization algorithm exists 
that incorporates a digital arithmetic unit and a minimum amount of memory that can be hardwired. 
The algorithm is based on recursively computing the base-2 representations of powers of the golden 
ratio. In Figure |9l cpn denotes the i?-bit base-2 representation of (p^"^. Mimicking the relation = 
_ (p-n+i^ jj^g digital circuit recursively sets 

<t>n = 4>n^2 - (Pn-l, n = 2,3, N - 1 

which then gets multiplied by qn and added to x„, where 

n-l 

Xn = ^qk(l)~'', n = l,2,...,N. 

k=0 

The circuit needs to be set up so that (pi is the expansion of in base 2, accurate up to at least B 
bits, in addition to the initial conditions (pQ = I and xq = 0. To minimize round-off errors, B could be 
taken to be a large number (much larger than log N/ log (p, which determines the output resolution). 



IV. Higher order schemes: Tribonacci and Polynacci encoders 

What made the Golden Ratio Encoder (or the 'Fibonacci' Encoder) interesting was the fact that a beta- 
expansion for 1 < /3 < 2 was attained via a difference equation with ±1 coefficients, thereby removing 
the necessity to have a perfect constant multiplier. (Recall that multipliers were still employed for the 
quantization operation, but they no longer needed to be precise.) 

This principle can be further exploited by considering more general difference equations of this same 
type. An immediate class of such equations are suggested by the recursion 

Pn+L = Pn+L-1 + ' ' ' + P-n 

where L > 1 is some integer. For L = 2, one gets the Fibonacci sequence if the initial condition is given 
by Pq = 0, Pi = 1. For L = 3, one gets the Tribonacci sequence when Pq = Pi = 0, P2 = 1. The 
general case yields the Polynacci sequence. 

For bit encoding of real numbers, one then sets up the iteration 

Un+L = Un+L^l H h U„ - 6„ 

bn = Q{Un,. ■ ■ ,Un+L^l) (39) 

with the initial conditions uq = x, ui = ■ ■ ■ = ul-i = 0- In L-dimensions, the iteration can be rewritten 
as 
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(40) 

••• ' ' ' ' ' 

1 1 ••• 

It can be shown that the characteristic equation 

has its largest root (3l in the interval (1,2) and all remaining roots inside the unit circle (hence is a 
Pisot number). Moreover as L ^ cxd, one has Pl —>■ 2 monotonically. 

One is then left with the construction of quantization rules Q = Qi that yield bounded sequences (un)- 
While this is a slightly more difficult task to achieve, it is nevertheless possible to find such quantization 
rules. The details will be given in a separate manuscript. 

The final outcome of this generalization is the accuracy estimate 



n=0 



whose rate becomes asymptotically optimal as L ^ oo. 
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